Benchmarking Blunders and Things That Go Bump in the Night
نویسنده
چکیده
Benchmarking—by which I mean any computer system that is driven by a controlled workload—is the ultimate in performance simulation. Aside from being a form of institutionalized cheating, it also offer countless opportunities for systematic mistakes in the way the workloads are applied and the resulting measurements interpreted. Right test, wrong conclusion is a ubiquitous mistake that happens because test engineers tend to treat data as divine. Such reverence is not only misplaced, it’s also a sure ticket to production hell when the application finally goes live. I demonstrate how such mistakes can be avoided by means of two war stories that are real WOPRs. (a) How to resolve benchmark flaws over the psychic hotline and (b) How benchmarks can go flat with too much Java juice! In each case I present simple performance models and show how they can be applied to correctly assess benchmark data.
منابع مشابه
Things that go bump in the night: searching for therapeutic targets and underlying mechanisms of night-time calf cramps
Methods 160 adults were recruited the Greater Newcastle and Central Coast regions of New South Wales, Australia: 80 who experienced night-time calf cramp at least once per week and 80 ageand sex-matched adults who did not. Participants were assessed using reliable tests of foot/ankle and toe strength, range of ankle dorsiflexion, hamstring flexibility, foot alignment, calf circumference, periph...
متن کاملThings that go bump in the CMB polarization: features from inflation versus reionization
Michael J. Mortonson, 2, ∗ Cora Dvorkin, 2, † Hiranya V. Peiris, ‡ and Wayne Hu 2, § Department of Physics, University of Chicago, Chicago IL 60637 Kavli Institute for Cosmological Physics and Enrico Fermi Institute, University of Chicago, Chicago IL 60637, U.S.A. Institute of Astronomy, University of Cambridge, Cambridge CB3 0HA, U.K. Department of Astronomy & Astrophysics, University of Chica...
متن کاملThings that go bump in the night: diagnosing sleep-related movement disorders without a sleep laboratory.
It is common for general physicians to experience diagnostic doubt and trepidation whenever faced with patients who exhibit abnormal nocturnal behaviours or excessive movements at night. There is also a perception that expensive and often poorly available overnight tests are usually required for diagnostic precision. In fact, the majority of conditions, whether they be parasomnias or, more rare...
متن کاملThe Rise of Patient Safety-II: Should We Give Up Hope on Safety-I and Extracting Value From Patient Safety Incidents?; Comment on “False Dawns and New Horizons in Patient Safety Research and Practice”
Who could disagree with the seemingly common-sense reasoning that: “We must learn from the things that go wrong.”? Despite major investments to improve patient safety, relatively few evaluations demonstrate convincing reductions in risk, harm, serious error or death. This disappointing trajectory of improvement from learning from errors or Safety-I as it is sometimes known has led some research...
متن کاملThings That Go Bump in the Mind : How Behavioral Economics Could
In their article, Ho, Lim, and Camerer (2006) lead by example. They identify principles from behavioral economics, and rather than simply exhort their readers to pay attention, they actually produce impressive demonstrations of how these principles can be applied to substantive marketing problems. It is easy to argue that these ideas are important, but it is more difficult to demonstrate that i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Texas dental journal
دوره 118 6 شماره
صفحات -
تاریخ انتشار 2001